Electronic device for recording image as per multiple frame rates using camera and method for operating same

ABSTRACT

An electronic device is provided. The electronic device includes at least one processor configured to obtain a plurality of first images as per a first frame rate using the camera based on a signal related to image recording and control the camera to perform focusing of a lens included in the camera on at least one of one or more objects in the plurality of first images while obtaining the plurality of first images, provide a first portion of the plurality of first images as a preview through the display, control the camera to lock the focusing on the at least one object, identify a designated event for slow motion recoding while obtaining the plurality of first images, based at least in part on the designated event, obtain a plurality of second images as per a second frame rate higher than the first frame rate using the camera focusing-locked on the at least one object, and provide a video related to the at least one object using a second portion of the plurality of first images and at least one of the plurality of second images.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a Continuation of U.S. application Ser. No.16/284,348, which was filed in the U.S. Patent and Trademark Office onFeb. 25, 2019, and claims priority under 35 U.S.C. § 119 to KoreanPatent Application Serial No. 10-2018-0022027, which was filed in theKorean Intellectual Property Office on Feb. 23, 2018, the entiredisclosure of each of which is incorporated herein by reference.

BACKGROUND 1. Field

The disclosure relates generally to electronic devices for recordingvideos in super slow motion and methods for operating the same.

2. Description of Related Art

Recently, electronic devices have been providing more diversifiedservices and additional functions. Various applications executable onelectronic devices are being developed to meet the diverse demands ofusers and to raise the utility of electronic devices,

Among these are camera applications, whereby the user may take a selfieor foreground picture using the camera of their electronic device. Theelectronic device may include a camera module for capturing images. Thecamera module may typically include a lens for collecting light, aphotodiode for converting the collected light into an electrical.signal, and an analog-to-digital converter (ADC) for converting theelectrical signal. The process of a camera module converting electricalsignals from multiple photodiodes into digital electrical signals andoutputting the digital electrical signals may be called “read-out.” Acamera module of an electronic device may provide an autofocus or manualfocus function.

When focusing is performed while capturing video in super slow motion, aread-out by the image sensor may be done before the calculation forfocusing is finished, and the resulting super slow motion video may endup with images not properly focused.

SUMMARY

The disclosure has been made to address at least the disadvantagesdescribed above and to provide at least the advantages described below.

According to an embodiment of the disclosure, an electronic device isprovided. The electronic device includes a camera, a display, a memory,and at least one processor configured to obtain a plurality of firstimages as per a first frame rate using the camera based on a signalrelated to image recording and control the camera to perform focusing ofa lens included in the camera on at least one of one or more objects inthe plurality of first images while obtaining the plurality of firstimages, provide a first portion of the plurality of first images as apreview through the display, control the camera to lock the focusing onthe at least one object, identify, a designated event for slow motionrecoding while obtaining the plurality of first images, based at leastin part on the designated event, obtain a plurality of second images asper a second frame rate higher than the first frame rate using thecamera focusing-locked on the at least one object, and provide a videorelated to the at least one object using a second portion of theplurality of first images and at least one of the plurality of secondimages.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features and advantages of certainembodiments of the disclosure will be more apparent from the followingdetailed description taken in. conjunction with the accompanyingdrawings, in which:

FIG. 1 is a diagram illustrating an electronic device in a networkenvironment, according to an embodiment of the disclosure;

FIG. 2 is a diagram illustrating a camera module, according to anembodiment of the disclosure;

FIG. 3 is a diagram illustrating a structure of an image sensor,according to an embodiment of the disclosure;

FIG. 4 is a diagram illustrating a process for obtaining an image framethrough an image sensor, according to an embodiment of the disclosure;

FIG. 5 is a flowchart illustrating a method for recording video in slowmotion by way of locking the focusing of a lens of an electronic device,according to an embodiment of the disclosure;

FIG. 6A is a diagram illustrating an operation in which an electronicdevice performs the focusing of a lens in response to a users touchinput, according to an embodiment of the disclosure;

FIG. 6B is a diagram illustrating an operation in which an electronicdevice performs the focusing of a lens based on a user input to select adegree of focus, according to an embodiment of the disclosure;

FIG. 7 is a diagram illustrating an example in which an electronicdevice initiates slow motion recording based on a movement of an objectin a designated region, according to an embodiment of the disclosure;

FIG. 8 is a diagram illustrating an example in which an electronicdevice resumes focusing after slow motion recording, according to anembodiment of the disclosure;

FIG. 9 is a flowchart of a method for capturing video on an electronicdevice in slow motion in response to identifying a movement of an objectin a designated range of a preview, according to an embodiment of thedisclosure; and

FIG. 10 is a flowchart of a method for capturing video on an electronicdevice in slow motion in response to identifying a user input related toinitiating slow motion recording, according to an embodiment of thedisclosure.

DETAILED DESCRIPTION

FIG. 1 is a block diagram illustrating an electronic device 101 in anetwork environment 100 according to various embodiments.

Referring to FIG. 1, the electronic device 101 in the networkenvironment 100 may communicate with an electronic device 102 via afirst network 198 (e.g., a short-range wireless communication network),or an electronic device 104 or a server 108 via a second network 199(e.g., a long-range wireless communication network). According to anembodiment, the electronic device 101 may communicate with theelectronic device 104 via the server 108. According to an embodiment,the electronic device 101 may include a processor 120, memory 130, aninput device 150, a sound output device 155, a display device 160, anaudio module 170, a sensor module 176, an interface 177, a haptic module179, a camera module 180, a power management module 188, a battery 189,a communication module 190, a subscriber identification module (SIM)196, or an antenna module 197. In some embodiments, at least one (e.g.,the display device 160 or the camera module 180) of the components maybe omitted from the electronic device 101, or one or more othercomponents may be added in the electronic device 101. In someembodiments, some of the components may be implemented as singleintegrated circuitry. For example, the sensor module 176 (e.g., afingerprint sensor, an iris sensor, or an illuminance sensor) may beimplemented as embedded in the display device 160 (e.g., a display).

The processor 120 may execute, e.g., software (e.g., a program 140) tocontrol at least one other component (e.g., a hardware or softwarecomponent) of the electronic device 101 connected with the processor 120and may process or compute various data, According to one embodiment, asat least part of the data processing or computation, the processor 120may load a command or data received from another component (e.g., thesensor module 176 or the communication module 190) in volatile memory132, process the command or the data stored in the volatile memory 132,and store resulting data in non-volatile memory 134. According to anembodiment, the processor 120 may include a main. processor 121 (e.g., acentral processing unit (CPU) or an application processor (AP)), and anauxiliary processor 123 (e.g., a graphics processing unit (GPU), animage signal processor (ISP), a sensor hub processor, or a communicationprocessor (CP)) that is operable independently from, or in conjunctionwith, the main processor 121. Additionally or alternatively, theauxiliary processor 123 may be adapted to consume less power than themain processor 121, or to be specific to a specified function. Theauxiliary processor 123 may be implemented as separate from, or as partof the main processor 121.

The auxiliary processor 123 may control at least some of functions orstates related to at least one (e.g., the display device 160, the sensormodule 176, or the communication module 190) of the components of theelectronic device 101, instead of the main processor 121 while the mainprocessor 121 is in an inactive (e.g., sleep) state or along with themain processor 121 while the main processor 121 is an active state(e.g., executing an application). According to an embodiment, theauxiliary processor 123 (e.g., an image signal processor or acommunication processor) may be implemented as part of another component(e.g., the camera module 180 or the communication module 190)functionally related to the auxiliary processor 123.

The memory 130 may store various data used by at least one component(e.g., the processor 120 or the sensor module 176) of the electronicdevice 101. The various data may include, for example, software (e.g.,the program 140) and input data or output data for a command relatedthereto. The memory 130 may include the volatile memory 132 or thenon-volatile memory 134.

The program 140 may be stored in the memory 130 as software, and mayinclude, for example, an operating system (OS) 142, middleware 144, oran application 146.

The input device 150 may receive a command or data to be used by anothercomponent (e.g., the processor 120) of the electronic device 101, fromthe outside (e.g., a user) of the electronic device 101. The inputdevice 150 may include, for example, a microphone, a mouse, or akeyboard.

The sound output device 155 may output sound signals to the outside ofthe electronic device 101. The sound output device 155 may include, forexample, a speaker or a receiver. The speaker may be used for generalpurposes, such as playing multimedia or playing record, and the receivermay be used for an incoming calls. According to an embodiment, thereceiver may be implemented as separate from, or as part of the speaker.

The display device 160 may visually provide information to the outside(e.g., a user) of the electronic device 101. The display device 160 mayinclude, for example, a display, a hologram device, or a projector andcontrol circuitry to control a corresponding one of the display,hologram device, and projector. According to an embodiment, the displaydevice 160 may include touch circuitry adapted to detect a touch, orsensor circuitry (e.g., a pressure sensor) adapted to measure theintensity of force incurred by the touch.

The audio module 170 may convert a sound into an electrical signal andvice versa. According to an embodiment, the audio module 170 may obtaina sound through the input device 150 or output a sound through the soundoutput device 155 or an external electronic device (e.g., an electronicdevice 102 (e.g., a speaker or a headphone) directly or wirelesslyconnected with the electronic device 101.

The sensor module 176 may detect an operational state (e.g., power ortemperature) of the electronic device 101 or an environmental state(e.g., a state of a user) external to the electronic device 101, andthen generate an electrical signal or data value corresponding to thedetected state. According to an embodiment, the sensor module 176 mayinclude, for example, a gesture sensor, a gyro sensor, an atmosphericpressure sensor, a magnetic sensor, an acceleration sensor, a gripsensor, a proximity sensor, a color sensor, an infrared (IR) sensor, abiometric sensor, a temperature sensor, a humidity sensor, or anilluminance sensor.

The interface 177 may support one or more specified protocols to be usedfor the electronic device 101 to be coupled with the external electronicdevice (e.g., the electronic device 102) directly (e.g., wiredly) orwirelessly. According to an embodiment, the interface 177 may include,for example, a high definition multimedia interface (HDMI), a universalserial bus (USB) interface, a secure digital (SD) card interface, or anaudio interface.

A connecting terminal 178 may include a connector via which theelectronic device 101 may be physically connected with the externalelectronic device (e.g., the electronic device 102). According to anembodiment, the connecting terminal 178 may include, for example, a HDMIconnector, a USB connector, a SD card connector, or an audio connector(e.g., a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanicalstimulus (e.g., a vibration or motion) or electrical stimulus which maybe recognized by a user via his tactile sensation or kinestheticsensation. According to an embodiment, the haptic module 179 mayinclude, for example, a motor, a piezoelectric element, or an electricstimulator.

The camera module 180 may capture a still image or moving images.According to an embodiment, the camera module 180 may include one ormore lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to theelectronic device 101. According to one embodiment, the power managementmodule 388 may be implemented as at least part of, for example, a powermanagement integrated circuit (PMIC).

The battery 189 may supply power to at least one component of theelectronic device 101. According to an embodiment, the battery 189 mayinclude, for example, a primary cell which is not rechargeable, asecondary cell which is rechargeable, or a fuel cell.

The communication module 190 may support establishing a direct (e.g.,wired) communication channel or wireless communication channel betweenthe electronic device 101 and an external electronic device (e.g., theelectronic device 102, the electronic device 104, or the server 108) andperforming communication through the established communication channel.The communication module 190 may include one or more communicationprocessors that are operable independently from the processor 120 (e.g.,the application processor (AP)) and supports a direct (e.g., wired)communication or a wireless communication. According to an embodiment,the communication module 190 may include a wireless communication module192 (e.g., a cellular communication module, a short-range wirelesscommunication module, or a global navigation satellite system (GNSS)communication module) or a wired communication module 191 (e.g., a localarea network (LAN) communication module or a power line communication(PLC) module). A corresponding one of these communication modules maycommunicate with. the external electronic device via the first network198 (e.g., a short-range communication network, such as Bluetooth™,wireless-fidelity (Wi-Fi) direct, or infrared data association (IrDA))or the second network 199 (e.g., a long-range communication network,such as a cellular network, the Internet, or a computer network (e.g.,LAN or wide area network (WAN)). These various types of communicationmodules may be implemented as a single component (e.g., a single chip),or may be implemented as multi components (e.g., multi chips) separatefrom each other. The wireless communication module 192 may identify andauthenticate the electronic device 101 in a communication network, suchas the first network 198 or the second network 199, using subscriberinformation (e.g., international mobile subscriber identity (IMSI))stored in the subscriber identification module 196.

The antenna module 197 may transmit or receive a signal or power to orfrom the outside (e.g., the external electronic device) of theelectronic device 101. According to an embodiment, the antenna module197 may include one or more antennas, and, therefrom, at least oneantenna appropriate for a communication scheme used in the communicationnetwork, such as the first network 198 or the second network 199, may beselected, for example, by the communication module 190 (e.g., thewireless communication module 192). The signal or the power may then betransmitted or received between the communication module 190 and theexternal electronic device via the selected at least one antenna.

At least some of the above-described components may be coupled mutuallyand communicate signals (e.g., commands or data) therebetween via aninter-peripheral communication scheme (e.g., a bus, general purposeinput and output (GPIO), serial peripheral interface (SPI), or mobileindustry processor interface (MIPI)).

According to an embodiment, commands or data may be transmitted orreceived between the electronic device 101 and the external electronicdevice 104 via the server 108 coupled with the second network 199. Thefirst and second external electronic devices 102 and 104 each may be adevice of the same or a different type from the electronic device 101.According to an embodiment, all or some of operations to be executed atthe electronic device 101 may be executed at one or more of the externalelectronic devices 102, 104, or 108. For example, if the electronicdevice 101 should perform a function or a service automatically, or inresponse to a request from a user or another device, the electronicdevice 101, instead of, or in addition to, executing the function or theservice, may request the one or more external electronic devices toperform at least part of the function or the service. The one or moreexternal electronic devices receiving the request may perform the atleast part of the function or the service requested, or an additionalfunction or an additional service related to the request, and transferan outcome of the performing to the electronic device 101. Theelectronic device 101 may provide the outcome, with or without furtherprocessing of the outcome, as at least part of a reply to the request.To that end, a cloud computing, distributed computing, or client-servercomputing technology may be used, for example.

FIG. 2 is a block diagram 200 illustrating the camera module 280 (e.g.,the camera module 180 of FIG. 1) according to various embodiments.

Referring to FIG. 2, the camera module 280 may include a lens assembly210, a flash 220, an image sensor 230, an image stabilizer 240, memory250 (e.g., buffer memory), or an image signal processor 260. The lensassembly 210 may collect light emitted or reflected from an object whoseimage is to be taken. The lens assembly 210 may include one or morelenses. According to an embodiment, the camera module 280 may include aplurality of lens assemblies 210. In such a case, the camera module 280may form, for example, a dual camera, a 360-degree camera, or aspherical camera. Some of the plurality of lens assemblies 210 may havethe same lens attribute (e.g., view angle, focal length, auto-focusing,f number, or optical zoom), or at least one lens assembly may have oneor more lens attributes different from those of another lens assembly.The lens assembly 210 may include, for example, a wide-angle lens or atelephoto lens.

The flash 220 may emit light that is used to reinforce light reflectedfrom an object, According to an embodiment, the flash 220 may includeone or more light emitting diodes (LEDs) (e.g., a red-green-blue (RGB)LED, a white LED, an infrared (IR) LED, or an ultraviolet (UV) LED) or axenon lamp. The image sensor 230 may obtain an image corresponding to anobject by converting light emitted or reflected from the object andtransmitted via the lens assembly 210 into an electrical signal.According to an embodiment, the image sensor 230 may include oneselected from image sensors having different attributes, such as a RGBsensor, a black-and-white (BW) sensor, an IR sensor, or a UV sensor, aplurality of image sensors having the same attribute, or a plurality ofimage sensors having different attributes. Each image sensor included inthe image sensor 230 may be implemented using, for example, a chargedcoupled device (CCD) sensor or a complementary metal oxide semiconductor(CMOS) sensor.

The image stabilizer 240 may move the image sensor 230 or at least onelens included in the lens assembly 210 in a particular direction, orcontrol an operational attribute (e.g., adjust the read-out timing) ofthe image sensor 230 in response to the movement of the camera module280 or the electronic device 101 including the camera module 180. Thisallows compensating for at least part of a negative effect (e.g., imageblurring) by the movement on an image being captured. According to anembodiment, the image stabilizer 240 may sense such a movement by thecamera module 280 or the electronic device 101 using a gyro sensor (notshown) or an acceleration sensor (not shown) disposed inside or outsidethe camera module 280. According to an embodiment, the image stabilizer240 may be implemented, for example, as an optical image stabilizer. Thememory 250 may store, at least temporarily, at least part of an imageobtained via the image sensor 230 for a subsequent image processingtask. For example, if image capturing is delayed due to shutter lag ormultiple images are quickly captured, a raw image obtained (e.g., aBayer-patterned image, a high-resolution image) may be stored in thememory 250, and its corresponding copy image (e.g., a low-resolutionimage) may be previewed via the display device 160. Thereafter, if aspecified condition is met (e.g., by a user's input or system command),at least part of the raw image stored in the memory 250 may be obtainedand processed, for example, by the image signal processor 260. Accordingto an embodiment, the memory 250 may be configured as at least part ofthe memory 130 or as a separate memory that is operated independentlyfrom the memory 130.

The image signal processor 260 may perform one or more image processingwith respect to an image obtained via the image sensor 230 or an imagestored in the memory 250. The one or more image processing may include,for example, depth map generation, three-dimensional (3D) modeling,panorama generation, feature point extraction, image synthesizing, orimage compensation (e.g., noise reduction, resolution adjustment,brightness adjustment, blurring, sharpening, or softening). Additionallyor alternatively, the image signal processor 260 may perform control(e.g., exposure time control or read-out timing control) with respect toat least one (e.g., the image sensor 230) of the components included inthe camera module 280. An image processed by the image signal processor260 may be stored back in the memory 250 for further processing, or maybe transferred to an external component (e.g., the memory 130, thedisplay device 160, the electronic device 102, the electronic device104, or the server 108) outside the camera module 280. According to anembodiment, the image signal processor 260 may distributively process atleast some of operations performed by the processor 120. According to anembodiment, the image signal processor 260 may be configured as at leastpart of the processor 120, or as a separate processor that is operatedindependently from the processor 120. If the image signal processor 160is configured as a separate processor from the processor 120, at leastone image processed by the image signal processor 160 may be displayed,by the processor 120, via the display device 160 as it is or after beingfurther processed.

According to an embodiment, the electronic device 101 may include aplurality of camera modules 280 having different attributes orfunctions. In such a case, at least one of the plurality of cameramodules 280 may form, for example, a wide-angle camera and at leastanother of the plurality of camera modules 180 may form a telephotocamera. Similarly, at least one of the plurality of camera modules 280may form, for example, a front camera and at least another of theplurality of camera modules 180 may form a rear camera.

FIG. 3 is a diagram illustrating a structure of an image sensor,according to an embodiment of the disclosure.

An image sensor 300 may be a component of a camera module in anelectronic device.

Referring to FIG. 3, the image sensor 300 may include at least one of apixel array 310, a row-driver 320, a column-readout circuit 330, acontroller 340, a memory 350, or an interface 360.

The pixel array 310 may include a plurality of pixels 311 to 319. Thepixel array 310 may have a structure in which the plurality of pixels311 to 319 are arrayed in an M×N matrix pattern (where M and N arepositive integers). The pixel array 310 where the plurality of pixels311 to 319 are arrayed in a two-dimensional (2D) M×N pattern may have Mrows and N columns. The pixel array 310 may include a plurality ofphotosensitive elements (e.g., photodiodes or pinned photodiodes). Thepixel array 310 may detect light using the plurality of photosensitiveelements and convert the light into an analog electrical signal togenerate an image signal.

The row-driver 320 may drive the pixel array 310 for each row. Therow-driver 320 may output transmission control signals to thetransmission transistors of the plurality of pixels 311 to 319 in thepixel array 310, reset control signals to control reset transistors, orselect control signals to control selection transistors to the pixelarray 310. The row-driver 320 may determine a row to be read out.

The column-readout circuit 330 may receive analog electrical signalsgenerated by the pixel array 310. The column-readout circuit 330 mayreceive an analog electrical signal from a column line selected fromamong the plurality of columns constituting the pixel. array 310. Thecolumn-readout circuit 330 may include an ADC 331 that may convert theanalog electrical signal received from the selected column line intopixel data (or a digital signal) and output the pixel data. Meanwhile,the column-readout circuit 330 that receives an analog electrical signalfrom the pixel array 310, converts the received analog electrical signalinto pixel data using the ADC 331, and outputs the pixel data may bereferred to as read-out. The column-readout circuit 330 and the ADC 331may determine a column to be read out.

The column-readout circuit 330 of the image sensor 300 that supports ofhigh speed photography may include a plurality of ADCs 331. Each of theplurality of ADCs 331 may be connected in parallel with a respective oneof the plurality of photodiodes in the pixel array 310, and analogelectrical signals simultaneously received from the plurality ofphotodiodes may quickly be converted into pixel data based on theparallel structure. The column-readout circuit 330 of the image sensor300 that supports of high speed photography may perform a read-out at ahigh frame rate (e.g., 960 frames per second (fps)). Reading out at 960fps means that receiving an analog electrical signal from the pixelarray 310, converting the received analog electrical signal into pixeldata using the ADC 331, and outputting the pixel data are performed onceevery 1/960 seconds. In other words, reading out at 960 fps may meanthat 960 image frames are outputted per second.

The controller 340 may obtain an image frame based on the pixel datareceived from the column-readout circuit 330. The controller 340 mayoutput the image frame through the interface 360 to an external circuit370 (e.g., an image signal processor (ISP), processor, communicationcircuit, or external server). The controller 340 may generatetransmission control signals to control the transmission transistors ofthe plurality of pixels 311 to 319, reset control signals to controlreset transistors, or select control signals to control selectiontransistors and provide the generated signals to the row-driver 320. Thecontroller 340 may generate a selection control signal to select atleast one column line from among the plurality of column linesconstituting the pixel array 310 and provide the generated signal to thecolumn-readout circuit 330. The column-readout circuit 330 may enablesome of the plurality of column lines and disable the other column linesbased on selection control signals provided from the controller 340. Thecontroller 340 may distributively process at least some of operationsperformed by the processor 120. The controller 340 may be implemented ina processor 120 including a CPU or AP, as a sort of block or module.When the controller 340 is implemented as a block, the controller 340may include a subtractor for detecting a difference between images, or acomparator for comparing images. The controller 340 may downsizeread-out images and compare the plurality of downsized images to detectdifferences between the images.

The memory 350 may include a volatile and/or non-volatile memory. Thememory 350 is a storage device inside the image sensor 300. The memory350 may include a buffer memory. The memory 350 may temporarily storedigital signals output from the column-readout circuit 330 or thecontroller 340. The memory 350 may include at least one image frameobtained based on light received by the pixel array 310. The memory 350may store at least one digital signal received from the external circuit370 through the interface 360.

The memory 350 may store at least one image frame read out at an Nthframe rate (e.g., 960 fps) or an Mth frame rate (e.g., 120 fps) from thecolumn-readout circuit 330 and deliver at least one image frame storedthrough the interface 360 to the external circuit 370 (e.g., an IPS,processor, communication circuit, or external server). In other words,the memory 350 may store at least one image frame read out once every1/960 seconds or every 1/120 seconds from the column-readout circuit330, and the memory 350 may deliver at least one image frame storedthrough the interface 360 to the external circuit 370. The speed atwhich the image frame is transferred to the external circuit 370 is notlimited thereto. The electronic device 101 may transfer immediately,without storing, the read-out image frame through the interface 360 tothe external circuit 370.

Meanwhile, the controller 340 may store only some of N image frames readout through the column-readout circuit 330 at the Nth frame rate (e.g.,960 fps) in the memory 350, allowing for substantially the same effectas if M image frames were obtained which are read out at the Mth framerate (e.g., 120 fps). For example, the controller 340 may store only oneof eight image frames read out at 960 fps for 8/960 seconds in thememory 350. When from among a plurality of image frames read out at 960fps, only image frames selected in the ratio of 1:8 are stored in thememory 350, the image frames stored in the memory 350 may besubstantially the same image frames as those read out at 120 fps throughthe column-readout circuit 330. When a video constituted of only imageframes obtained at the cycle of 1/120 seconds is defined as ‘120 fpsvideo,’ a video constituted of only image frames selected in the ratioof 1:8 from among the plurality of image frames read out at 960 fps maybe defined as a 120 fps video. A video constituted of only image framesread out at 120 fps through the column-readout circuit 330 may also bedefined as a 120 fps video.

The interface 360 may include the interface 177 or the communicationmodule 190. The interface 360 may connect components of the image sensor300 (e.g., the controller 340 or the memory 350) with the externalcircuit 370 in a wireless or wired scheme. The interface 360 may deliverat least one image frame stored in the memory 350 of the image sensor300 to the external circuit 370. (e.g., the memory 130of the electronicdevice 101). The interface 360 may also deliver control signals from theprocessor 120 to the controller 340 of the image sensor 300.

The image sensor 300 may communicate with the external circuit 370through the interface 360 (e.g., in a serial communication scheme). Thememory 350 of the image sensor 300 may communicate with the processor120 in an inter-integrated circuit (I²C) scheme.

The image sensor 300 may connect with the external circuit 370 throughthe interface 360 (e.g., an interface as defined as per the mobileindustry processor interface (MIPI) protocol). The memory 350 of theimage sensor 300 may communicate with the processor 120 as per theinterface defined in the MIPI protocol. The interface 360 (e.g., theinterface defined as per the MIPI protocol) may deliver pixel datacorresponding to the image frames stored in the memory 350 to theexternal circuit 370 at the cycle of 1/120 seconds.

Meanwhile, while the image frames stored in the memory 350 are deliveredthrough the interface 360 having an output speed of 240 fps to theexternal circuit 370 once every 1/120 seconds, at least some of theimage frames read out in real-time through the column-readout circuit330 may be delivered to the external circuit 370 as preview images onceevery 1/120 seconds. The processor 120 in the external circuit 370 maydisplay, through the display, all or some of the image frames output aspreview images from the image sensor 300 at 30 fps or 60 fps.

All or some of the above-described components 310 to 360 may be includedin the image sensor 300 as necessary, and each component may beconfigured in a single unit or multiple units. The frame rates 120 fps,240 fps, and 960 fps, may be varied depending on the settings of theelectronic device or the performance of the interface.

FIG. 4 is a diagram illustrating a process for obtaining an image framethrough an image sensor, according to an embodiment. An image sensor 400may be a component of a camera module in an electronic device.

Referring to FIG. 4, the image sensor 400 may include at least one apixel array 410, a memory 450, and an interface 460. The image sensor400 may include the whole or part of the image sensor 300 of FIG. 3.

The pixel array 410 of the image sensor 400 may output an electricalsignal corresponding to light received from the outside. The pixel array410 may include a plurality of pixels constituted of photodiodes. Thephotodiodes may receive light and generate analog electrical signalscorresponding to the received light. Analog electrical signals generatedfrom the plurality of photodiodes constituting the plurality of pixelsmay be converted into a plurality of pieces of pixel data through acolumn-readout circuit. In this case, each piece of pixel data may meana pixel value corresponding to its respective pixel. A set of aplurality of pieces of pixel data obtained at a particular time mayconstitute at least one image frame.

The pixel array 410 of the image sensor 400 may output a plurality ofimage frames 421 to 424 at a preset read-out speed. When the read-outspeed is set to 960 fps, the image sensor 400 may read-out 960 imageframes per second based on light received by the pixel array 410. Theelectronic device 101 may detect an event of slow motion recording whilerecording in a normal mode in which case the electronic device 101 mayturn the read-out rate from 120 fps to 950 fps.

The plurality of image frames 421 to 424 read out may be stored in amemory 450 inside the image sensor 400. The memory 450 of the imagesensor 400 may include a buffer memory 451. Some of the plurality ofimage frames 421 to 424 read out at 960 fps may be stored in the buffermemory 451. From among a plurality of image frames continuously readout, a designated number of image frames may be stored in the buffermemory 451. The processor may repeat the operations of deleting theimage frame stored earliest from among the image frames stored in thebuffer memory 451 and storing the image frame latest from among theimage frames.

At least one image frame stored in the memory 450 of the image sensor400 may be delivered to an external circuit 470 through the interface460. The processor may control the interface 460 to deliver at least oneimage frame stored in the memory 450 to the external circuit 470.

The image sensor 400 may exclude the buffer 451. The image frames 421,422, 423, and 424 from the pixel array 410 may directly be transferredthrough the interface 460 to the external circuit 470.

FIG. 5 is a flowchart of a method for locking the focusing of a lensassembly 210 of an electronic device 101 and capturing an image in slowmotion, according to an embodiment. FIG. 6A is a diagram illustrating anoperation in which an electronic device 101 performs the focusing of alens assembly 210 in response to a user's touch input, according to anembodiment. FIG. 6B is a diagram illustrating an operation in which anelectronic device 101 performs the focusing of a lens assembly 210 basedon user input to select the degree of focus, according to an embodiment.FIG. 7 is a diagram illustrating an example in which an electronicdevice 101 initiates slow motion recording based on a movement of anobject in a designated region, according to an embodiment.

At step 501, the electronic device 101 (e.g., at least one of theprocessor 120 of FIG. 1 or the controller 340 of FIG. 3) may obtain aplurality of first images as per a first frame rate on one or moreobjects using a camera 180 based on a signal related to image recording.For example, upon receiving an input regarding running a cameraapplication or an input to start recording video from the user, theelectronic device 101 may obtain the plurality of first images as perthe first frame rate (e.g., 30 fps or 60 fps).

The electronic device 101 (e.g., at least one of the processor 120 orthe controller 340) may control the camera to perform a focusing of alens assembly 210 included in the camera 180 on at least one object fromamong one or more objects while obtaining the plurality of first images.The electronic device 101 may focus on the at least one object includedin a designated region in the plurality of first images. The electronicdevice 101 may focus on an object included in the region of interest(ROI) included in the plurality of first images. The electronic device101 may focus on the plurality of first images using continuousautofocus-type contrast auto-focusing. The electronic device 101 mayperform the focusing using an optical triangulation system or aphase-difference detection system, but focusing is not limited thereto.

The electronic device 101 (e.g., at least one of the processor 120 orthe controller 340) may control the camera to perform the focusing ofthe lens assembly 210 for the objects corresponding to a region wherethe user's touch input is obtained. As shown in FIG. 6A, the electronicdevice 101 may receive the user's touch input through the display 160and control the camera to perform the focusing of the lens assembly 210onto the object corresponding to the region 610 where the touch input isreceived. The electronic device 101 may control the camera to performthe focusing of the lens assembly 210 based on user input to select thedegree of focus. As shown in FIG. 6B, the electronic device 101 maydisplay a user interface 620 for selecting the degree of focus on theplurality of first images through the display 160. The electronic device101 may control the camera to perform the focusing of the lens assembly210 based on the user input to select the degree of focus through theuser interface 620. The above-described focusing methods amount to amere example, and embodiments of the disclosure are not limited thereto.

The electronic device 101 (e.g., at least one of the processor 120 orthe controller 340) may control the camera to perform adjusting exposureof the camera 180 on at least one object from among one or more objectswhile obtaining the plurality of first images. The electronic device 101may adjust its exposure by adjusting at least one of the aperture orshutter speed of the camera 180 or sensitivity (e.g., the InternationalOrganization of Standardization (ISO)) of the image sensor 230. Theelectronic device 101 (e.g., at least one of the processor 120 or thecontroller 340) may control the camera to perform adjusting exposure ofthe camera 180 on at least one object. The electronic device 101 (e.g.,at least one of the processor 120 or the controller 340) may control thecamera to perform adjusting exposure of the camera 180 on at least oneobject while locking the focusing.

At step 503, the electronic device 101 (e.g., the processor 120) mayprovide a first portion of the plurality of first images as a previewthrough the display 160. The electronic device 101 may display all orsome of the image frames, which have been output in the preview from theimage sensor 230, through the display 160 at 30 fps or 60 fps.

At step 505, the electronic device 101 (e.g., at least one of theprocessor 120 or the controller 340) may control the camera to lock thefocusing using the camera 180 to prevent a change of the focusing on atleast one object. The electronic device 101 (e.g., at least one of theprocessor 120 or the controller 340) may control the camera 180 to lockthe adjusting the exposure to prevent a change of the exposure on the atleast one object. The electronic device 101 (e.g., at least one of theprocessor 120 or the controller 340) may control the camera 180 to lockthe adjusting the exposure to prevent a change of the exposure on the atleast one object while locking the focusing.

At step 507, the electronic device 101 (e.g., the processor 120) mayidentify a designated event in relation to obtaining the plurality offirst images. The electronic device 101 (e.g., the processor 120) mayidentify a user input related to initiating slow motion recording aspart of identifying the designated event. As shown in FIG. 6B, theelectronic device 101 may display a user interface 630 related toinitiating slow motion recording through the display 160 and identifythe reception of a user input through the user interface 630. Inresponse to receiving a user interface through the user interface 630related to initiating slow motion recording, the electronic device 101may lock the focusing to prevent defocusing on at least one object usingthe camera. In response to receiving a user interface through the userinterface 630 related to initiating slow motion recording, theelectronic device 101 may lock the adjustment of exposure to prevent achange in exposure from occurring on at least one object using thecamera 180.

The electronic device 101 (e.g., at least one of the processor 120 orthe controller 340) may obtain a plurality of third images as per athird frame rate through the image sensor 230 included in the camera 180based on a movement of the electronic device 101, as part of identifyingthe designated event. As shown in 701 of FIG. 7, upon detecting amovement of the electronic device 101, the electronic device 101 maychange the readout speed from the first frame rate, 30 fps or 60 fps, toa third frame rate of 120 fps, through the image sensor 230 and obtain aplurality of third images as per the third frame rate of 120 fps. Thethird frame rate may be higher than the first frame rate and be equal toor lower than a second frame rate. The electronic device 101 mayidentify a movement of an object in a region 710 of the plurally ofthird images. As shown in 702, the electronic device 101 may display thepreview on the display 160 using at least one image of the plurality ofthird images and may identify a movement of an object (or a variation inpixel value in the ROI 710) using a designated region (e.g., the ROI710) of the preview displayed. When the variation in pixel value in thedesignated region 710 of the displayed preview is not less than athreshold, the electronic device 101 may determine that an objectmovement is identified. The object movement may refer to various factorsto vary the pixel value, such as, but not limited to, an object movingfrom outside the region 710 to the inside of the region 710, an objectmoving out of the region 710, or an object inside the region 710reshaping. The electronic device 101 may identify whether there is amovement of the electronic device 101 within a designated time, and whenno movement of the electronic device 101 is identified within the time,the electronic device 101 may identify a movement of an object in thedesignated region 710 of the preview. The electronic device 101 mayidentify a movement of the object in the designated region 710 of thepreview using the camera 180 of which the focusing has been locked. Theelectronic device 101 may identify a movement of the object in thedesignated region 710 of the preview using the exposureadjustment-locked camera 180. In response to identifying a movement ofthe object in the designated region 710 of the preview, the electronicdevice 101 may lock the focusing to prevent defocusing on at least oneobject using the camera 180. In response to identifying a movement ofthe object in the designated region 710 of the preview, the electronicdevice 101 may lock the exposure adjustment to prevent the exposure fromchanging on at least one object using the camera 180.

At step 509, the electronic device 101 (e.g., at least one of theprocessor 120 or the controller 340) may obtain a plurality of secondimages at the second frame rate, which is higher than the first framerate, using the focusing-locked camera 180 based at least in part on thedesignated event.

The electronic device 101 at least one of the processor 120 or thecontroller 340) may obtain the plurality of second images as per thesecond frame rate using the focusing-locked camera 180 based onidentifying a user input related to initiating slow motion recording. Asshown in FIG. 6B, based on identifying the reception of the user inputthrough the user interface 630, the electronic device 101 may obtain theplurality of second images at a frame rate of 960 fps using thefocusing-locked camera 180. The electronic device 101 may obtain theplurality of second images as per the second frame rate using theexposure adjustment-locked camera 180 in response to identifying a userinput related to initiating slow motion recording. Based at least inpart on the designated event, the electronic device 101 may obtain theplurality of second images as per the second frame rate using a camera180 which locks at least one of the focusing or the adjusting theexposure.

The electronic device 101 (e.g., at least one of the processor 120 orthe controller 340) may obtain the plurality of second images as per thesecond frame rate using the focusing-locked camera 180 based onidentifying a movement of an object in a designated region of at leastone of the plurality of the first images. As shown in 702, based onidentifying the movement of an object in the designated region 710 of atleast one of the plurality of the first images, the electronic device101 may obtain the plurality of second images at a frame rate of 960 fpsusing the focusing-locked camera 180. The electronic device 101 mayobtain the plurality of second images as per the second frame rate usingthe exposure adjustment-locked camera 180 based on identifying themovement of an object in the designated region of the at least one ofthe plurality of the first images.

At step 511, the electronic device 101 (e.g., at least one of theprocessor 120 or the controller 340) may provide a video related to atleast one object of the one or more objects using a second portion ofthe plurality of first images and at least one of the plurality ofsecond images. The electronic device 101 may provide a video related toan object by merging at least one of the plurality of first imagesobtained at a frame rate of 30 fps or 60 fps and at least one of theplurality of second images obtained at a frame rate of 960 fps. Theelectronic device 101 may play the provided video through the display160 as per a fourth frame rate. The fourth frame rate may be the same asor different from the first frame rate. The electronic device 101 mayplay the provided video at a frame rate of 30 fps or 60 fps through thedisplay 160.

FIG. 8 is a diagram illustrating an example in which an electronicdevice 101 resumes focusing after slow motion recording, according to anembodiment. FIG. 9 is a flowchart of a method for capturing video on anelectronic device 1101 in slow motion in response to identifying themovement of an object in a designated range of a preview, according toan embodiment. The embodiment of FIG. 9 is described in detail withreference to FIGS. 6B, 7, and 8.

At step 901, the electronic device 101 (e.g., at least one of theprocessor 230 or the controller 340 in the image sensor 230) may obtaina plurality of first images as per a first frame rate on one or moreobjects using a camera 180 based on a signal related to image recording.The electronic device 101 may obtain a plurality of first images as pera frame rate of 30 fps or 60 fps on objects using the camera 180 basedon the image recording-related signal. The electronic device 101 mayperform the focusing of a lens assembly 210 included in the camera 180for at least one object from among one or more objects while obtainingthe plurality of first images. The electronic device 101 may perform thefocusing using the focusing step 501 of FIG. 5.

The electronic device 101 (e.g., at least one of the processor 120 orthe controller 340) may store one or more images of the plurality offirst images for background recording in the memory 130. When theelectronic device 101 meets a designated condition for deleting at leastone image from the memory, the electronic device 101 may delete at leastone image of the one or more images of the plurality of first imagesstored in the memory 130. Based on a designated time being elapsed sincethe recording-related signal is provided, the electronic device 101 mayidentify that the designated condition is met, and based on thedesignated condition being met, sequentially delete at least one imageof the one or more images of the plurality of first images stored in theorder of the storage. Based on one or more images of the plurality offirst images for background recording being stored in the memory 130 bya predetermined range or capacity since the recording-related signal isprovided, the electronic device 101 may identify that the designatedcondition is met, and based on the designated condition being met,sequentially delete at least one image of the one or more images of theplurality of first images stored in the order of the storage.

At step 903, the electronic device 101 (e.g., at least one of theprocessor 120 or the controller 340) may identify whether there ismovement of the electronic device 101. The electronic device 101 mayidentify whether there is movement of the electronic device 101 within apredetermined time using sensor module 176. As shown in 701 of FIG. 7,the electronic device 101 may identify sensor data through the sensormodule 176 during the predetermined time, and when the sensor data isless than a threshold, the electronic device 101 may determine thatthere is no movement of the electronic device 101. The electronic device101 may sense the movement of the electronic device 101 based on atleast one of a gyro sensor or an acceleration sensor. As a sensor todetect the movement of the electronic device 101, the gyro sensor or theacceleration sensor is merely an example, but is not limited thereto.

At step 905, the electronic device 101 (e.g., at least one of theprocessor 120 or the controller 340) may lock the focusing of the lensassembly 210 included in the camera 180 on at least one object of one ormore objects. The electronic device 101 may lock the focusing based onno movement of the electronic device 101.

At step 907, the electronic device 101 (e.g., at least one of theprocessor 120 or the controller 340) may identify the movement of anobject in a designated region of at least one image as a preview. Basedon no movement of the electronic device 1101 being identified, theelectronic device 101 may operate in slow motion recording standby mode.In the slow motion recording standby mode, the electronic device 101 maychange the read-out speed of the image sensor 230 from the first framerate corresponding to the plurality of first images to the third framerate corresponding to the plurality of third images and object theplurality of third images as per the third frame rate. For example, inthe slow motion recording standby mode, the electronic device 101 maychange a read-out speed of 30 fps or 60 fps to a read-out speed of 120fps and obtain a plurality of images at the read-out speed of 120 fps.The third frame rate may be higher than the first frame rate and beequal to or lower than the second frame rate.

Based on identifying, no movement of the electronic device 101, theelectronic device 101 (at least one of the processor 120 or thecontroller 340) may identify the movement of an object in the designatedregion 710 of at least one of the plurality of first images or in thedesignated region 710 of at least one of the plurality of third images.As shown in 702 of FIG. 7, based on identifying no movement of theelectronic device 101, the electronic device 101 may identify whetherthere is movement of the object in the designated region 710. When thepixel variation in the designated region 710 of the plurality of imagesis larger than a threshold related to the movement of the object, theelectronic device 101 may determine that there is movement of theobject. The electronic device 101 may identify the movement of theobject in the designated region 710 of the plurality of images using thefocusing-locked camera. In response to identifying the movement of theobject in the designated region 710 of the plurality of images, theelectronic device 101 may lock the focusing on the object.

At step 909, the electronic device 101 (e.g., at least one of theprocessor 120 of FIG. 1 or the controller 340 of FIG. 3) may obtain aplurality of second images at the second frame rate, which is higherthan the first frame rate, using the focusing-locked camera 180, Asshown 702 of FIG. 7, upon identifying the movement of an object in thedesignated region 710, the electronic device 101 may obtain theplurality of second images at a frame rate of 960 fps, which is higherthan the frame rate of 30 fps or 60 fps, using the focusing-lockedcamera 180. While obtaining the plurality of second images, theelectronic device 101 may read out the plurality of second images as perthe second frame rate through the image sensor 230 and store theplurality of second images in the memory 130 as per the second framerate.

The electronic device 101 (e.g., at least one of the processor 120 orthe controller 340) may control the camera 180 to perform focusing basedon the driving speed of the lens assembly 210 and the read-out speed ofthe image sensor 230. When the time for the focusing of the lensassembly 210 is equal to or shorter than the read-out time, theelectronic device 101 may control the camera to perform the focusing ofthe lens assembly 210. When the time for the focusing of the lensassembly 210 is 1/960 seconds, and the read-out time of the image sensor230 operating at a frame rate of 120 fps is 1/120 seconds, theelectronic device 101 may perform focusing.

The electronic device 101 (e.g., at least one of the processor 120 orthe controller 340) may control the camera to perform focusing based onthe moving distance of the object for the read-out time of the imagesensor 230. The electronic device 101 may identify the moving distanceof the object along the optical axis through the sensor module 176(e.g., an IR sensor). The electronic device 101 may identify the movingdistance of the object based on at least one image frame obtained byperforming the focusing. Based on the moving distance of the objectalong the optical axis with respect to the read-out time of the imagesensor 230 being not less than the depth of focus, the electronic device101 may control the camera 180 to perform focusing. Based on theread-out time of the image sensor 230 operating at a frame rate of 120fps being 1/120 seconds, and the moving distance of the object along theoptical axis during the time being not less than the depth of focus, theelectronic device 101 may control the camera 180 to perform focusing. Atstep 911, the electronic device 101 (e.g., at least one of the processor120 or the controller 340) may control the camera 180 to resume thefocusing of the lens assembly 210 based on stopping obtaining theplurality of second images. When a slow lotion recording terminationevent occurs, the electronic device 101 may stop obtaining the pluralityof second images. As the slow motion recording termination event, theelectronic device 101 may determine that the slow motion recordingtermination event has occurred when a designated time elapses after thetime of obtaining the plurality of second images. As the slow motionrecording termination event, the electronic device 101 may determinethat the slow motion recording termination event has occurred when theplurality of second images are stored in the memory 130 by a designatednumber of image frames or by a designated capacity. As the slow motionrecording termination event, the electronic device 101 may determinethat the slow motion recording termination event has occurred when userinput is identified through a user interface related to the terminationof the slow motion recording. When the slow motion recording terminationevent occurs, the electronic device 101 may control the camera 180 toresume the focusing using the focusing step 501 of FIG. 5.

The electronic device 101 (e.g., at least one of the processor 120 orthe controller 340) may control the camera 180 to resume the focusing ofthe lens assembly 210 by moving the lens assembly 210 from a firstposition at the time of resuming the focusing to a second position awayfrom where the at least one object is positioned. When the distancebetween the electronic device 101 and an object 810 increases as shownin FIG. 8, the electronic device 101 may control the camera 180 toresume the focusing of the lens assembly 210 by moving the position 820of the lens assembly 210 at the time of resuming the focusing away fromwhere the object 810 is positioned.

At step 913, the electronic device 101 (e.g., at least one of theprocessor 120 or the controller 340) may identify whether a videorecording termination event has occurred. As shown in FIG. 7, uponidentifying a user input related to the termination of video recordingthrough the user interface 720, the electronic device 101 may identifythat the video recording termination event has occurred.

Upon identifying no video recording termination event, the electronicdevice 101 (e.g., at least one of the processor 120 or the controller340) may return to step 901, obtaining a plurality of first images forone or more objects as per the first frame rate. From the time ofstopping obtaining the plurality of second images or the time ofobtaining the plurality of first images, the electronic device 101 mayperform part of background recording at step 901. From the time ofstopping obtaining the plurality of second images or the time ofobtaining the plurality of first images, the electronic device 101 maystore at least one image of the plurality of first images in the memory130, and when a designated condition is met at step 901, the electronicdevice 101 may delete at least some of the plurality of first imagesstored in the memory 130.

At step 915, the electronic device 101 (e.g., at least one of theprocessor 120 of FIG. 1 or the controller 340 of FIG. 3) may provide avideo related to an object using at least one image of the plurality offirst images and at least one image of the plurality of second images.The electronic device 101 may provide a video related to the objects bymerging at least one image of the plurality of first images obtained ata frame rate of 30 fps or 60 fps and at least one image of the pluralityof second images obtained at a frame rate of 960 fps. The electronicdevice 101 may store the video related to the objects in the memory 130.Based on stopping obtaining the plurality of second images, theelectronic device 101 may provide the video related to the objects usingat least one image of the plurality of first images and at least oneimage of the plurality of second images. The electronic device 101 mayplay the provided video through the display 160 as per a fourth framerate. The fourth frame rate may be the same as or different from thefirst frame rate. The electronic device 101 may play the provided videoat a frame rate of 30 fps or 60 fps through the display 160.

FIG. 10 is a flowchart of a method for capturing video on an electronicdevice 101 in slow motion in response to identifying a user inputrelated to initiating slow motion recording, according to an embodiment.

At step 1001, the electronic device 101 (e.g., at least one of theprocessor 230 or the controller 340 in the image sensor 230) may obtaina plurality of first images as per a first frame rate on one or moreobjects using a camera 180 based on a signal related to image recording.The electronic device 101 may obtain a plurality of first images as pera frame rate of 30 fps or 60 fps on objects using the camera 180 basedon the image recording-related signal. The electronic device 101 mayperform the focusing of a lens assembly 210 included in the camera 180on at least one object from among one or more objects while obtainingthe plurality of first images. The electronic device 101 may control thecamera 180 to perform the focusing using the focusing step 501 of FIG.5.

The electronic device 101 (e.g., the processor 120) may store at leastone image of the plurally of first images for background recording inthe memory 130. The electronic device 101 may perform the backgroundrecording using the background recording step 901 of FIG. 9.

At step 1003, the electronic device 101 (e.g., the processor 120) mayidentify user input related to initiating slow motion recording. Asshown in FIG. 6B, the electronic device 101 may display a user interface630 related to initiating slow motion recording through the display 160and identify the reception of the user input, which is related toinitiating slow motion recording, through the user interface 630.

At step 1005, the electronic device 101 (e.g., at least one of theprocessor 120 or the controller 340) may control the camera 180 to lockthe focusing of the lens assembly 210 included in the camera 180 on atleast one object of one or more objects. Based on obtaining a userinterface through the user interface 630 related to initiating slowmotion recording, the electronic device 101 may control the camera 180to lock the focusing to prevent a change of the focusing on at least oneobject using the camera 180.

At step 1007, the electronic device 101 (e.g., at least one of theprocessor 120 of FIG. 1 or the controller 340 of FIG. 3) may obtain aplurality of second images at the second frame rate, which is higherthan the first frame rate, using the focusing-locked camera 180, Asshown in FIG. 6B, based on a user input being received through the userinterface 630 related to initiating slow motion recording, theelectronic device 101 may obtain the plurality of second images at aframe rate of 960 fps, which is higher than the frame rate of 30 fps or60 fps, using the focusing-locked camera 180. While obtaining theplurality of second images, the electronic device 101 may read out theplurality of second images as per the second frame rate through theimage sensor 230 and store the plurality of second images in the memory130 as per the second frame rate.

At step 1009, the electronic device 101 (e.g., at least one of theprocessor 120 or the controller 340) may control the camera 180 toresume the focusing of the lens assembly 210 based on stopping obtainingthe plurality of second images. The electronic device 101 may controlthe camera 180 to resume the focusing using the step 911 of FIG. 9 ofresuming focusing.

At step 1011, as shown in FIG. 7, based on identifying user inputrelated to the termination of video recording through the user interface720, the electronic device 101 (e.g., the processor 120) may identifythat the video recording termination event has occurred.

Upon identifying no video recording termination event, the electronicdevice 101 may return to step 1001, obtaining a plurality of firstimages for one or more objects as per the first frame rate. From thetime of stopping obtaining the plurality of second images or the time ofobtaining the plurality of first images, the electronic device 101 mayperform part of background recording at step 1001. From the time ofstopping obtaining the plurality of second images or the time ofobtaining the plurality of first images, the electronic device 101 maystore at least one image of the plurality of first images in the memory130, and when a designated condition is met at step 901, the electronicdevice 101 may delete one or more images of the plurality of firstimages stored in the memory 130.

At step 1013, the electronic device 101 may provide a video related toan object using at least one image of the plurality of first images andat least one image of the plurality of second images. The electronicdevice 101 may provide a video related to the objects by merging atleast one image of the plurality of first images obtained at a framerate of 30 fps or 60 fps and at least one image of the plurality ofsecond images obtained at a frame rate of 960 fps. The electronic device101 may store the video related to the objects in the memory 130. Basedon stopping obtaining the plurality of second images, the electronicdevice 101 may provide the video related to the objects using at leastone image of the plurality of first images and at least one image of theplurality of second images. The electronic device 101 may play theprovided video through the display 160 as per a fourth frame rate. Thefourth frame rate may be the same as or different from the first framerate. The electronic device 101 may play the provided video at a framerate of 30 fps or 60 fps through the display 160.

The electronic device may be one of various types of electronic devices.The electronic devices may include, for example, a portablecommunication device (e.g., a smart phone), a computer device, aportable multimedia device, a portable medical device, a camera, awearable device, or a home appliance. The electronic device is notlimited to the above-listed embodiments.

It should be appreciated that various embodiments of the disclosure andthe terms used therein are not intended to limit the technologicalfeatures set forth herein to particular embodiments and include variouschanges, equivalents, or replacements for a corresponding embodiment.With regard to the description of the drawings, similar referencenumerals may be used to refer to similar or related elements. It is tobe understood that a singular form of a noun corresponding to an itemmay include one or more of the things, unless the relevant contextclearly indicates otherwise. As used herein, each of such phrases as “Aor B,” “at least one of A and B,” “at least one of A or B,” “A, B, orC,” “at least one of A, B, and C,” and “at least one of A, B, or C,” mayinclude all possible combinations of the items enumerated together in acorresponding one of the phrases. As used herein, such terms as “1st”and “2nd,” or “first” and “second” may be used to simply distinguish acorresponding component from another, and does not limit the componentsin other aspect (e.g., importance or order). It is to be understood thatif an element (e.g., a first element) is referred to, with or withoutthe term “operatively” or “communicatively”, as “coupled with,” “coupledto,” “connected with,” or “connected to” another element (e.g., a secondelement), it means that the element may be coupled with the otherelement directly (e.g., wiredly), wirelessly, or via a third element.

As used herein, the term “module” may include a unit implemented inhardware, software, or firmware, and may interchangeably be used withother terms, for example, “logic,” “logic block,” “part,” or “circuity”.A module may be a single integral component, or a minimum unit or partthereof, adapted to perform one or more functions. For example,according to an embodiment, the module may be implemented in a form ofan application-specific integrated circuit (ASIC).

Various embodiments as set forth herein may be implemented as software(e.g., the program 140) including one or more instructions that arestored in a storage medium (e.g., internal memory 136 or external memory138) that is readable by a machine (e.g., the electronic device 101).For example, a processor (e.g., the processor 120) of the machine (e.g.,the electronic device 101) may invoke at least one of the one or moreinstructions stored in the storage medium, and execute it, with orwithout using one or more other components under the control of theprocessor. This allows the machine to be operated to perform at leastone function according to the at least one instruction invoked. The oneor more instructions may include a code generated by a complier or acode executable by an interpreter. The machine-readable storage mediummay be provided in the form of a non-transitory storage medium. Wherein,the term “non-transitory” simply means that the storage medium is atangible device, and does not include a signal (e.g., an electromagneticwave), but this term does not differentiate between where data issemi-permanently stored in the storage medium and where the data istemporarily stored in the storage medium.

According to an embodiment, a method may be provided in a computerprogram product. The computer program products may be traded ascommodities between sellers and buyers. The computer program product maybe distributed in the form of a machine-readable storage medium (e.g.,compact disc read only memory (CD-ROM)), or be distributed (e.g.,downloaded or uploaded) online via an application store (e.g., PlayStore™), or between two user devices (e.g., smart phones) directly. Ifdistributed online, at least part of the computer program product may betemporarily generated or at least temporarily stored in themachine-readable storage medium, such as memory of the manufacturer'sserver, a server of the application store, or a relay server.

According to an embodiment, an electronic device includes a camera, adisplay, a memory, and at least one processor configured to obtain aplurality of first images for one or more objects as per a first framerate using the camera based on a signal related to image recording andcontrol the camera to perform focusing of a lens included in the cameraon. at least one of the one or more objects while obtaining theplurality of first images, provide a first portion of the plurality offirst images as a preview through the display, control the camera tolock the focusing to prevent a change of the focusing on the at leastone object, identify a designated event related to obtaining theplurality of first images, based at least in part on the designatedevent, obtain a plurality of second images as per a second frame ratehigher than the first frame rate using the focusing-locked camera , andprovide a video related to the at least one object using a secondportion of the plurality of first images and at least one of theplurality of second images.

The at least one processor may be configured to focus on the at leastone object included in a designated region within the plurality of firstimages.

The at least one processor may be configured to control the camera toperform the focusing of the lens using contrast auto-focusing.

The at least one processor may be configured to control the camera toperform the focusing of the lens on the at least one objectcorresponding to a region where a user's touch input is obtained orcontrol the camera to perform the focusing of the lens based on a userinput to select a degree of focus.

The at least one processor may be configured to obtain a plurality ofthird images as per a third frame rate through an image sensor includedin the camera based on a movement of the electronic device as part ofidentifying the designated event, identify a movement of an object in adesignated region of at least one of the plurality of third images, andbased on identifying the movement of the object in the designated regionof the at least one of the plurality of third images, obtain theplurality of second images as per the second frame rate using thecamera.

The at least one processor may be configured to obtain the plurality ofthird images as per the third frame rate higher than the first framerate.

The at least one processor may be configured to control the camera toperform adjusting exposure of the camera on the at least one objectwhile locking the focusing, control the camera to lock the adjusting theexposure to prevent a change of the exposure on the at least one objectwhile locking the focusing, and based at least in part on the designatedevent, obtain the plurality of second images as per the second framerate higher than the first frame rate using the exposureadjustment-locked camera.

The at least one processor may be configured to, based on stoppingobtaining the plurality of second images, control the camera to resumethe focusing of the lens.

The at least one processor may be configured to store a third portion ofthe plurality of first images for background recording in the memory,and based on a designated condition being met, delete at least one imageof the third portion of the plurality of first images stored in thememory from the memory.

The at least one processor may be configured to, based on a designatedtime being elapsed since the recording-related signal is provided,identify that the designated condition is met, and based on thedesignated condition being met, delete the at least one image of thethird portion of the plurality of first images from the memory, or basedon the third portion of the plurality of first images for backgroundrecording being stored in the memory by a predetermined range or apredetermined capacity since the recording-related signal is provided,identify that the designated condition is met, and based on thedesignated condition being met, delete the at least one image of thethird portion of the plurality of first images from the memory.

According to an embodiment, a method for operating an electronic deviceconfigured to record an image includes obtaining a plurality of firstimages for one or more objects as per a first frame rate using a camerabased on a signal related to image recording and controlling the camerato perform focusing of a lens included in the camera on at least one ofthe one or more objects while obtaining the plurality of first images,providing a first portion of the plurality of first images as a previewthrough a display, controlling the camera to lock the focusing toprevent a change of the focusing on the at least one object, identifyinga designated event related to obtaining the plurality of first images,based at least in part on the designated event, obtaining a plurality ofsecond images as per a second frame rate higher than the first framerate using the focusing-locked camera, and providing a video related tothe at least one object using a second portion of the plurality of firstimages and at least one of the plurality of second images.

Controlling the camera to perform the focusing of the lens may includefocusing on the at least one object included in a designated regionwithin the plurality of first images.

Controlling the camera to perform the focusing of the lens may includeperforming the focusing of the lens using contrast auto-focusing.

Controlling the camera to perform the focusing of the lens may includecontrolling the camera to perform the focusing of the lens on the oneobject corresponding to a region where a user's touch input is obtainedor controlling the camera to perform the focusing of the lens based on auser input to select a degree of focus.

Identifying the designated event may include obtaining a plurality ofthird images as per a third frame rate through an image sensor includedin the camera based on a movement of the electronic device, andidentifying a movement of an object in a designated region of at isleast one of the plurality of third images. Obtaining the plurality ofsecond images may include, based on identifying the movement of theobject in the designated region of the at least one of the plurality ofthird images, obtaining the plurality of second images as per the secondframe rate using the camera.

Obtaining the plurality of third images may include obtaining theplurality of third images as per the third frame rate higher than thefirst frame rate.

The method may further include controlling the camera to performadjusting exposure of the camera on the at least one object whilelocking the focusing, control the camera to lock the adjusting theexposure to prevent a change of the exposure on the at least one objectwhile locking the focusing, and based at least in part on the designatedevent, obtaining the plurality of second images as per the second framerate higher than the first frame rate using the exposureadjustment-locked camera.

The method may further include, based on stopping obtaining theplurality of second images, controlling the camera to resume thefocusing of the lens.

The method may further include storing a third portion of the pluralityof first images for background recording in a memory, and based on adesignated condition being met, deleting at least one of the thirdportion of the plurality of first images stored in the memory from thememory. Deleting from the memory may include, based on a designated timebeing elapsed since the recording-related signal is provided,identifying that the designated condition is met, and based on thedesignated condition being met, deleting the at least one image of thethird portion of the plurality of first images from the memory, or basedon the third portion of the plurality of first images for backgroundrecording being stored in the memory by a predetermined range or apredetermined capacity since the recording-related signal is provided,identifying that the designated condition is met, and based on thedesignated condition being met, deleting the at least one image of thethird portion of the plurality of first images from the memory.

According to an embodiment, there is provided a non-transitory computerreadable recording medium storing instructions for executing anoperation of an electronic device including a camera, a display amemory, and at least one processor, the operation including obtaining aplurality of first images for one or more objects as per a first framerate using a camera based on a signal related to image recording andcontrolling the camera to perform focusing of a lens included in thecamera on at least one of the one or more objects while obtaining theplurality of first images, providing a first portion of the plurality offirst images as a preview through a display, controlling the camera tolock the focusing to prevent a change of the focusing on the at leastone object, identifying a designated event related to obtaining theplurality of first images, based at least in part on the designatedevent, obtaining a plurality of second images as per a second frame ratehigher than the first frame rate using the focusing-locked camera, andproviding a video related to the at least one object using a secondportion of the plurality of first images and at least one of theplurality of second images.

According to various embodiments, each component (e.g., a module or aprogram) of the above-described components may include a single entityor multiple entities. According to various embodiments, one or more ofthe above-described components may be omitted, or one or more othercomponents may be added. Alternatively or additionally, a plurality ofcomponents (e.g., modules or programs) may be integrated into a singlecomponent. In such a case, according to various embodiments, theintegrated component may still perform one or more functions of each ofthe plurality of components in the same or similar manner as they areperformed by a corresponding one of the plurality of components beforethe integration. According to various embodiments, operations performedby the module, the program, or another component may be carried outsequentially, in parallel, repeatedly, or heuristically, or one or moreof the operations may be executed in a different order or omitted, orone or more other operations may be added.

As is apparent from the foregoing description, according to variousembodiments, an electronic device may lock focusing before initiatingsuper slow motion video recording and record super slow motion videousing the focusing-locked camera, obtaining a super slow motion videowith the user's desired focus quality. According to various embodiments,an electronic device may provide a focusing method appropriate for superslow motion video recording.

While the disclosure has been shown and described with reference tocertain exemplary embodiments thereof, it will be understood by thoseskilled in the art that various changes in form and details may be madetherein without departing from the spirit and scope of the disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. An electronic device, comprising: a camera; adisplay; a memory; and at least one processor configured to: obtain aplurality of first images as per a first frame rate using the camerabased on a signal related to image recording and control the camera toperform focusing of a lens included in the camera on at least one of oneor more objects in the plurality of first images while obtaining theplurality of first images, provide a first portion of the plurality offirst images as a preview through the display, control the camera tolock the focusing on the at least one object, identify a designatedevent for slow motion recoding while obtaining the plurality of firstimages, based at least in part on the designated event, obtain aplurality of second images as per a second frame rate higher than thefirst frame rate using the camera focusing-locked on the at least oneobject, and provide a video related to the at least one object using asecond portion of the plurality of first images and at least one of theplurality of second images.